![]() Holographic visualization of process information on a portable display device
专利摘要:
公开号:SE1500285A1 申请号:SE1500285 申请日:2015-06-23 公开日:2015-06-25 发明作者:Ralph Maria 申请人:Abb Technology Ltd; IPC主号:
专利说明:
15 20 25 similar to browse through a series of process pictures and related data. Use of desktop screens also limits the numbers of users and therefore hinders collaboration possibilities between local and / or remote users. Thus, today, in process plants, workers working both in control rooms and remotely commonly rely on state-of-the-art mechanisms such as computer displays for understanding process information in different environments. In addition remote workers speaking with their colleagues also rely on 2D images via video streaming, if available. The state-of-the-art mechanisms thereby limit the sense of connection not only between co-workers but also between workers and the process they are in control of. Hence, there is still a need for an improved provision of process information related to a process plant. SUMMARY An object of embodiments herein is to provide efficient provision of process information related to a process plant. According to a Rst aspect there is presented a computer implemented method for displaying process information on a portable holographic display device. The method comprises acquiring process information related to a process plant. The method further comprises determining how to display the process information. The method also comprises rendering a three-dimensional holographic image of the process information on a display of the portable holographic display device according to the determination of how to display the process information. Advantageously this provides efñcient provision of process information related to a process plant. Advantageously this enables awareness of operation of the process plant. Another advantage is that the embodiments described herein can be used to support Collaborative work, therefore enabling faster decision making. 10 15 20 25 30 A further advantage is that workers, especially remote workers, are provided with a more intuitive way of seeing and understanding the process they are controlling. The workers are also enabled to engage in collaborative discussions with co-workers. Yet another advantage is that, by providing workers with an intuitive interaction experience, they can connect more easily with both the process at- hand and other team members, thus improving situation awareness and faster resolution of problems encountered. This would in turn result in improved efficiency and productivity of workers. According to a second aspect there is presented a portable holographic display device for displaying process information. The portable holographic display device comprises processing circuitry. The processing circuitry is con Gured to cause the portable holographic display device to perform a set of operations. The set of operations provide instructions that enable the portable holographic display device to acquire process information related to a process plant. The set of operations further provide instructions that enable the portable holographic display device to determine how to display the process information. In addition, the set of operations provide instructions that enable the portable holographic display device to render a three-dimensional holographic image of the process information on a display of the portable holographic display device according to the determination of how to display the process information. According to a third aspect there is presented a computer program for displaying process information on a portable holographic display device, the computer program comprising computer program code which, when run on the portable holographic display device, causes the portable holographic display device to perform a method according to the rst aspect. According to a fourth aspect there is presented a computer program product comprising a computer program according to the third aspect and computer readable means on which the computer program is stored. 10 15 20 25 It is to be noted that any feature of the Rst, second, third and fourth aspects may be applied to any other aspect, wherever appropriate. Likevvise, any advantage of the Rst aspect may equally apply to the second, third, and / or fourth aspect, respectively, and vice versa. Other objectives, features and advantages of the enclosed embodiments will be apparent from the following detailed disclosure, from the attached dependent claims as well as from the drawings. Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the technical Eld, unless explicitly de Ned otherwise herein.A1lreferences to "a / an / the element, apparatus, component, means, step, etc . " are to be interpreted openly as referring to at least one instance of the element, apparatus, component, means, step, etc., unless explicitly stated otherwise. The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless explicitly stated. BRIEF DESCRIPTION OF THE DRAWIN GS The inventive concept is now described, by way of example, with reference to the accompanying drawings, in which: Fig. 1 is a schematic diagram illustrating a process control system according to embodiments; Fig. 2 is a schematic diagram showing functional units of a portable holographic display device according to an embodiment; Fig. 3 shows one example of a computer program product comprising computer readable means according to an embodiment; Fig. 4 is a Owchart of methods according to embodiments presented herein; and Figs. 5 and 6 schematically illustrate embodiments of a portable holographic display device rendering a three-dimensional holographic image. 10 15 20 25 30 DETAILED DESCRIPTION The inventive concept will now be described more fully hereinafter with reference to the accompanying drawings, in which certain embodiments of the inventive concept are shown. This inventive concept may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided by way of example so that this disclosure will be thorough and complete, and will fully convey the scope of the inventive concept to those skilled in the art. Like numbers refer to like elements throughout the description. Any step or feature illustrated by dashed lines should be considered as optional. F ig. 1 is a schematic diagram illustrating a process control system 10 where embodiments presented herein can be applied. The process control system 10 comprises portable holographic display devices 11, 12 and a process plant 13. Data can be communicated between the portable holographic display devices 11, 12 and a process plant 13 over a network 14. The network 10 may at least partly be a wireless network, such as a cellular communication system. The network 10 may be a local network or a wide area network, or a combination of both. As such the network 10 may comprise a plurality of physical devices and logical entities, for example network nodes, servers, etc. The embodiments disclosed herein relate to displaying process information on a portable holographic display device. In order to achieve this there is provided a portable holographic display device, a method performed by the portable holographic display device, a computer program comprising code, for example in the form of a computer program product, which when run on the portable holographic display device , causes the portable holographic display device to perform the method. Fig. 2 schematically illustrates, in terms of a number of functional units, the components of a portable holographic display device 11, 12 according to an embodiment. Processing circuitry 21 is provided using any combination of one or more of a suitable central processing unit (CPU), multiprocessor, microcontroller, digital signal processor (DSP), application specific 10 15 20 25 30 integrated circuit (ASIC), field programmable gate arrays (FPGA) etc., capable of executing software instructions stored in a computer program product 31 (such as illustrated in Fig. 3), eg in the form of a storage medium 23. The storage medium 23 may also comprise persistent storage, which, for example, can be any single one or combination of magnetic memory, optical memory, solid state memory or even remotely mounted memory. For example, the storage medium 23 may store a computer generated model of the process plant 13. The portable holographic display device 11, 12 may further comprise a communications interface 22 for communications with another portable holographic display device 11, 12 and / or a process plant 13. As such the communications interface 22 may comprise one or more transmitters and receivers, comprising analogue and digital components and a suitable number of antennas for wireless communications and ports for wireline communications. The portable holographic display device 11, 12 may further comprise an image capturing unit 25. The image capturing unit 25 may be con Gured to capture a three-dimensional representation of an object. As such, the image capturing unit 25 may be implemented by one or more cameras. Particularly, the processing circuitry 21 is con Gured to cause the portable holographic display device 11, 12 to perform a set of operations, or steps, A102-S120. These operations, or steps, S102-S120 will be disclosed below. For example, the storage medium 23 may store the set of operations, and the processing circuitry 21 may be con Gured to retrieve the set of operations from the storage medium 23 to cause the portable holographic display device 11, 12 to perform the set of operations. The set of operations may be provided as a set of executable instructions. Thus the processing circuitry 21 is thereby arranged to execute methods as herein disclosed. The processing circuitry 21 controls the general operation of the portable holographic display device 11, 12 e.g. by sending data and control signals to 10 15 20 25 30 the communications interface 22, the storage medium 23, and the image capturing unit 25, by receiving data and reports from the communications interface 22, by retrieving data and instructions from the storage medium 23 , and by receiving captured image information from the image capturing unit 25. Other components, as well as the related functionality, of the portable holographic display device 11, 12 are omitted in order not to obscure the concepts presented herein. The portable holographic display device 11, 12 may be a mobile station, a mobile phone, a handset, a wireless local loop phone, a user equipment (UE), a smartphone, a laptop a computer, or a tablet computer. Fig. 3 shows one example of a computer program product 31 comprising computer readable means 33. On this computer readable means 33, a computer program 32 can be stored, which computer program 32 can cause the processing circuitry 21 and thereto operatively coupled entities and devices , such as the communications interface 22 and the storage medium 23, to execute methods according to embodiments described herein. The computer program 32 and / or computer program product 31 may thus provide means for performing any steps as herein disclosed. In the example of Fig. 3, the computer program product 31 is illustrated as an optical disc, such as a CD (compact disc) or a DVD (digital versatile disc) or a Blu-Ray disc. The computer program product 31 could also be embodied as a memory, such as a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or an electrically erasable programmable read- only memory (EEPROM) and more particularly as a non-volatile storage medium of a device in an external memory such as a USB (Universal Serial Bus) memory or a Flash memory, such as a compact Flash memory. Thus, while the computer program 32 is here schematically shown as a track on the depicted optical disk, the computer program 32 can be stored in any way which is suitable for the computer program product 31. 10 15 20 25 Fig. 4 is a ow chart illustrating embodiments of methods for displaying process information on a portable holographic display device 11. The methods are performed by the portable holographic display device 11. The methods are advantageously carried out by means of computer programs 32. Reference is now made to an embodiment for displaying process information on a portable holographic display device 11 as performed by the portable holographic display device 11 as illustrated in Fig. 4. Parallel references are made to the process control system 10 of Fig. 1 and the embodiments of the portable holographic display device 11 rendering a three-dimensional holographic image in Figs. 5 and 6. The portable holographic display device 11 is con Gured to, in a step S104, acquire process information related to a process plant 13. The portable holographic display device 11 is con Gured to, in a step S106, determine how to display the process information. The portable holographic display device 11 is con Gured to, in a step S108, render a three-dimensional holographic image 50, 60 of the process information on a display 24 of the portable holographic display device 11 according to the determination. Hence, this involves integrating a holographic display 24 with a portable holographic display device 11 for interacting with a control system (e.g. 800xA® by ABB) of a process plant 13 and / or at least one other portable holographic display device 12. Human operators working independently could display a hologram of the process plant 13 to obtain a three-dimensional impression of the status of components. In addition a human operator can contact another human operator and obtain a hologram of that human operator which provides a more connected experience for the human operators. F ig. 5 shows a Rst example of how a three-dimensional holographic image 50 representing process graphics could be displayed on a portable 10 15 20 25 holographic display device 11. F ig. 6 shows second example of how a three-dimensional holographic image 60 representing a human operator could be displayed on a portable holographic display device 11. In general terms, rendering is herein de Ned as the process of generating a three-dimensional image from a three-dimensional representation (or model, in what collectively could be called a scene Le), by means of the processing circuitry 21. Reference is continued to the made to Owchart of Fig. 4 for methods for displaying process information on a portable holographic display device 11 as performed by the portable holographic display device 11 according to further embodiments. There may be different examples of when in time the portable holographic display device 11 is to acquire the process information in step S104. According to an embodiment the portable holographic display device 11 is con Gured to, in a step S102, receive user input identifying the process plant 13. This input (or the reception thereof) may act as a trigger for the portable holographic display device 11 to acquire the process information, as in step S104. Hence the process information may be acquired in response to receiving the user input identifying the process plant 13. There may be further different examples of how the portable holographic display device 11 acts once it has acquired the process information related to the process plant 13. For example, the portable holographic display device 11 may share the three-dimensional holographic image 50, 60 with another the portable holographic display device 12. Particularly, according to an embodiment the portable holographic display device 11 is con gured to, in a step S110, transmit an encoded version of the three-dimensional holographic image 50, 60 to at least one other portable holographic display device 12. How to encode a three-dimensional holographic image is as such known in the art and further description thereof is therefore omitted. 10 15 20 25 30 10 The portable holographic display device 11 may further receive a three-dimensional holographic image from another portable holographic display device 12. Particularly, according to an embodiment the portable holographic display device 11 is con Gured to, in a step S112, receive an encoded version of another three-dimensional holographic image from another portable holographic display device 12. The portable holographic display device 11 may then be con Gured to, in a step S114, decode the received three-dimensional holographic image. How to decode an encoded three-dimensional holographic image is as such known in the art and further description thereof is therefore omitted. The portable holographic display device 11 may then be con Gured to, in a step S116, render a three-dimensional holographic image of this decoded three-dimensional holographic image. Information could be pulled into the hologram to be shared among human operators and discussed around for improved problem solving. Therefore, according to an embodiment the portable holographic display device 11 is con Gured to, in a step S118, receive an indication of further data. This further data may represent information that could be pulled into the hologram to be shared. Therefore, according to this embodiment the portable holographic display device 11 is con Gured to, in a step S120, incorporate the further data in the three-dimensional holographic image 50, 60. There may be different examples of from where the indication may be received. For example, the indication may be received as user input or from another portable holographic display device 12. There may be different examples of process information. For example, the process information may represent process graphics, trend data of the process plant 13, a human operator of the process plant 13, or any combination thereof. In this respect, Fig. 5 schematically illustrates a portable holographic display device 11, 12 rendering a three-dimensional holographic image 50 representing process graphics and comprising a first three-dimensional holographic image object 51 and a second three-dimensional holographic image object 52. Further, Fig. 6 schematically illustrates a portable holographic display device 11, 12 rendering a three- 10 15 20 25 11 dimensional holographic image 60 representing a human operator and comprising a single three-dimensional holographic image object 61. There may be different ways for how the portable holographic display device 11, 12 may acquire the process information. For example the process information may be acquired from an image capturing unit 25. For example the process information may be acquired from a computer generated model of the process plant 13. As noted above, the storage medium 23 of the portable holographic display device 11, 12 may store such a computer generated model of the process plant 13. Additionally or alternatively, the portable holographic display device 11, 12 may acquire such a computer generated model of the process plant 13 from the process plant 13 or from another portable holographic display device 11, 12. Yet alternatively, the portable holographic display device 11, 12 may acquire such a computer generated model of the process plant 13 from an entity, such as a server, in the network 14. The present invention could be used in a plurality of scenarios. Three such scenarios are brie Y summarized next. According to the first scenario the present invention could be used to efficiently monitor and understand the control process of the process plant 13 by improving spatial-temporal reasoning for improved decision making. According to a second scenario the present invention could be used to enable effective communication between human operators that are working remotely to foster a sense of teamwork. According to a third scenario the present invention could be used to enable sharing of information between human operators (i.e., to provide the ability for human operators to point to and show information for discussing around, etc.) to promote collaboration. 12 The inventive concept has mainly been described above with reference to a few embodiments. However, as is readily appreciated by a person skilled in the art, other embodiments than the ones disclosed above are equally possible within the scope of the inventive concept, as defined by the appended patent claims.
权利要求:
Claims (15) [1] A computer implemented method for displaying process information on a portable holographic display device (11), comprising: acquiring (S104) process information related to a process plant (13); determining (S106) how to display said process information; and rendering (S108) a three-dimensional holographic image (50, 60) of said process information on a display (24) of said portable holographic display device according to said determination of how to display said process information. [2] The method according to claim 1, further comprising: receiving (S102) user input identifying said process plant; and wherein said process information is acquired in response thereto. [3] The method according to claim 1, further comprising: transmitting (S110) an encoded version of said three-dimensional holographic image to at least one other portable holographic display device (12). [4] The method according to claim 1, further comprising: receiving (S112) an encoded version of another three-dimensional holographic image from another portable holographic display device (12); decoding (S114) said another three-dimensional holographic image; and rendering (S116) a three-dimensional holographic image of said decoded another three-dimensional holographic image. [5] 5. The method according to claim 1, wherein the process information represents process graphics, trend data of said process plant, and / or a human operator of said process plant. [6] The method according to claim 1, wherein process information is acquired from an image capturing unit (25). [7] The method according to claim 1, wherein process information is acquired from a computer generated model of said process plant. 10 15 20 25 14 [8] The method according to claim 1, further comprising: receiving (S118) an indication of further data; and incorporating (S120) said further data in said three-dimensional holographic image. [9] The method according to claim 8, wherein said indication is received as user input or from another portable holographic display device (12). [10] 10. A portable holographic display device (11, 12) for displaying process information, the portable holographic display device comprising processing circuitry (21), the processing circuitry being con Gured to cause the portable holographic display device to perform a set of operations comprising : acquiring process information related to a process plant (13); determining how to display said process information; and rendering a three-dimensional holographic image (50, 60) of said process information on a display (24) of said portable holographic display device according to said determination of how to display said process information. [11] 11. The portable holographic display device according to claim 10, further comprising a storage medium (23) storing said set of operations, and wherein the processing circuitry is con Gured to retrieve said set of operations from the storage medium to cause the portable holographic display device to perform said set of operations. [12] 12. The portable holographic display device according to claim 10 or 11, wherein said set of operations is provided as a set of executable instructions. [13] 13. The portable holographic display device according to claim 10, 11 or 12, wherein said portable holographic display device is a mobile phone. [14] 14. A computer program (32) for displaying process information on a portable holographic display device (11, 12), the computer program comprising computer code which, when run on processing circuitry (21) of the portable holographic display device, causes the portable holographic 10 15 display device to: acquire (S104) process information related to a process plant (13); determine (S106) how to display said process information; and render (S108) a three-dimensional holographic image (50, 60) of said process information on a display (24) of said portable holographic display device according to said determination of how to display said process information. [15] 15. A computer program product (31) comprising a computer program (32) according to claim 14, and a computer readable means (33) on which the computer program is stored.
类似技术:
公开号 | 公开日 | 专利标题 KR101718373B1|2017-03-21|Video play method, terminal, and system AU2014389509B2|2019-04-18|Techniques to selectively capture visual media using a single interface element TWI488537B|2015-06-11|A setting method and the device of the connecting to the access point US10171164B2|2019-01-01|2D barcode-based bi-directional wireless transmission system CN105163193A|2015-12-16|Method and device for comment information sharing of video-on-demand played by smart television US10165229B2|2018-12-25|Network communication system and method thereof US10440441B2|2019-10-08|Image pickup apparatus, image pickup system, control method for image pickup apparatus, and recording medium CN104852987A|2015-08-19|Screen capture transmission system for family internet equipment KR101984825B1|2019-05-31|Method and Apparatus for Encoding a Cloud Display Screen by Using API Information CN108427545B|2021-07-09|Screenshot data processing method, device and system, storage medium and processor CN107342981B|2021-11-12|Sensor data transmission method and device and virtual reality head-mounted equipment SE1500285A1|2015-06-25|Holographic visualization of process information on a portable display device WO2014096519A1|2014-06-26|Method and apparatus for sharing content US10931959B2|2021-02-23|Systems and methods for real-time video transcoding of streaming image data US20190281306A1|2019-09-12|Method for Bandwidth Reduction When Streaming Large Format Multi-Frame Image Data CN103019912A|2013-04-03|Processing monitoring data in a monitoring system CN110545431A|2019-12-06|video decoding method and device and video encoding method and device EP2728860A2|2014-05-07|Integration of video surveillance systems US10341674B2|2019-07-02|Method and device for distributing load according to characteristic of frame US10795635B2|2020-10-06|Systems and methods for spatial and temporal highlighting of changes to streaming image data KR20150043011A|2015-04-22|Method for transmitting picture data thereof, and the device KR20140017878A|2014-02-12|Image monitoring system and method for operating the same CN104601927A|2015-05-06|Method and system for loading real-time video in application program interface and electronic device KR101475936B1|2014-12-23|3d media distribution system KR20190026523A|2019-03-13|Terminal apparatus and data communication method thereof
同族专利:
公开号 | 公开日 SE1500285A2|2015-09-01|
引用文献:
公开号 | 申请日 | 公开日 | 申请人 | 专利标题
法律状态:
2016-01-26| NAV| Patent application has lapsed|
优先权:
[返回顶部]
申请号 | 申请日 | 专利标题 SE1500285A|SE1500285A2|2015-06-23|2015-06-23|SE1500285A| SE1500285A2|2015-06-23|2015-06-23| 相关专利
Sulfonates, polymers, resist compositions and patterning process
Washing machine
Washing machine
Device for fixture finishing and tension adjusting of membrane
Structure for Equipping Band in a Plane Cathode Ray Tube
Process for preparation of 7 alpha-carboxyl 9, 11-epoxy steroids and intermediates useful therein an
国家/地区
|